Method and apparatus for measuring user quality of experience QOE

ABSTRACT

The present invention discloses a method for measuring user quality of experience QoE, where the method includes the following steps: receiving event information sent by a receiving end, where the event information includes condition information for determining a cause for shortage of valid media data in a buffer of the receiving end; determining, according to the condition information, whether the shortage of the valid media data in the buffer of the receiving end is caused by a service system or caused by a user&#39;s action; and measuring QoE decrease degrees according to different causes for the shortage of the valid media data in the buffer, respectively. In the method for measuring QoE according to embodiments of the present invention, shortage of valid media data in a buffer of a receiving end caused by a service system problem and shortage of valid media data in the buffer of the receiving end caused by a user&#39;s action are distinguished, and QoE decrease degrees are measured according to different causes for the shortage of the valid media data in the buffer, respectively, so that QoE is measured more accurately and more objectively, and network resources can be used properly.

TECHNICAL FIELD

The present invention relates to the network management field, and inparticular, to a method and an apparatus for measuring user quality ofexperience QoE.

BACKGROUND

In a network application, a network provider and a service providernormally very care about quality of an IPTV (Internet ProtocolTelevision, Internet Protocol Television) service as user watching. Aconventional quality of service (Quality of Service, QoS) parameter isincompetent to obviously reflect user experience. In order to indicatethe effect of user experience of the IPTV service more directly, aquality of experience (Quality of Experience, QoE) parameter emerges.The QoE may be understood as user experience or user perception, thatis, a subjective feeling of an end user about performance of a serviceprovided by a network. By using a nearly quantitative approach, it mayrepresent the end user's experience and feeling about the service andnetwork, and reflect a gap between user's expectation and quality of acurrent service and network.

In the related art, it is proposed that in a video service, if a troubleoccurs on a network, that is, QoS decreases, a video service, beingwatched at a user end, may be caused to stop therefore, which incursrebuffering to receiving end. When the rebuffering occurs at thereceiving end, the receiving end sends event information to a QoEmonitoring server. Upon reception of the event information, the QoEmonitoring server starts QoS adjustment to adjust network conditions,thereby ensuring QoE. However, in fact, the rebuffering at the receivingend may also be caused by an operation of the user. For example, in aprocess of presenting/watching media, dragging performed actively by auser may cause a receiving end to send event information. The receivingend stops and sends the event information, which are caused by thedragging performed by the user, and are unpredictable and cannot bedistinguished by a QoE monitoring server. In the prior art, for eitherthe rebuffering at the receiving end caused by deterioration of anetwork condition or the rebuffering at the receiving end caused bydragging performed by the user, the QoE server measures a change rate ofthe QoE by using the same QoE measuring method, and starts correspondingQoS adjustment according to the change rate of the QoE to improve thequality of a network server. However, in cases of the rebuffering causedby dragging performed by the user, the network QoS does not decrease. Insuch cases, starting a QoS adjustment policy may occupy more networkresources to some extent, so as to increase a burden on a network andresult in improper use of resources. In addition, in the prior art, itis deemed that the QoE will definitely decrease if the QoS decreases, sothat QoS adjustment may be immediately started. When a jitter or a datadelay occurring occasionally in a network causes the QoE to slightlydecrease, the QoS adjustment also needs to be started, so that the QoSadjustment is not flexible, resulting in improper use of networkresources.

SUMMARY

To make the proper use of network resources, the present inventionprovides a method for measuring user quality of experience QoE, wherethe method is capable of allowing a server to determine a cause forrebuffering a media service, thereby further measuring a QoE decreasedegree.

A method for measuring user quality of experience QoE includes thefollowing steps:

receiving event information sent by a receiving end, where the eventinformation includes condition information for determining a cause forshortage of valid media data in a buffer of the receiving end;

determining, according to the condition information, whether theshortage of the valid media data in the buffer of the receiving end iscaused by a service system or caused by a user's action; and

measuring QoE decrease degrees according to different causes for theshortage of the valid media data in the buffer, respectively.

An apparatus for measuring user quality of experience QoE includes:

a receiving module, configured to receive event information sent by areceiving end, where the event information includes conditioninformation for determining a cause for shortage of valid media data ina buffer of the receiving end;

a determining module, configured to determine, according to thecondition information, whether the shortage of the valid media data inthe buffer of the receiving end is caused by a service system or causedby a user's action; and

a QoE measuring module, configured to measure QoE decrease degreesaccording to different causes for the shortage of the valid media datain the buffer, respectively.

In the method and apparatus for measuring QoE according to embodimentsof the present invention, the receiving end sends event information,where a cause for the shortage of the valid media data in the buffer ofthe receiving end is reflected by using condition information in theevent information, so that the shortage of the valid media data in thebuffer of the receiving end caused by a service system problem and theshortage of the valid media data in the buffer of the receiving endcaused by a user's action are distinguished. Further, QoE decreasedegrees may be measured according to different causes for the shortageof the valid media data in the buffer, respectively, so that the QoE ismeasured more accurately and more objectively, and network resources canbe used properly.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a flowchart of a method for measuring QoE according to anembodiment of the present invention;

FIG. 2 is a flowchart for measuring a QoE decrease degree in a methodfor measuring QoE in FIG. 1;

FIG. 3 is a flowchart of a method for measuring QoE according to anotherembodiment of the present invention;

FIG. 4 is a schematic diagram of an apparatus for measuring QoEaccording to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a QoE measuring module in an apparatusfor measuring QoE in FIG. 4; and

FIG. 6 is a schematic diagram of an apparatus for measuring QoEaccording to another embodiment of the present invention.

DESCRIPTION OF EMBODIMENTS

The present invention provides a method for measuring user quality ofexperience, where the method includes:

receiving event information sent by a receiving end, where the eventinformation includes condition information for determining a cause forshortage of valid media data in a buffer of the receiving end;

determining, according to the condition information, whether theshortage of the valid media data in the buffer of the receiving end iscaused by a service system or caused by a user's action; and

measuring QoE decrease degrees according to different causes for theshortage of the valid media data in the buffer, respectively.

In the method for measuring QoE according to an embodiment of thepresent invention, condition information in event information sent by areceiving end is used to determine a cause for shortage of valid mediadata in a buffer of the receiving end, so that the shortage of the validmedia data in the buffer of the receiving end caused by a service systemproblem and the shortage of the valid media data in the buffer of thereceiving end caused by a user's action are distinguished; and QoEdecrease degrees are measured according to the different causes for theshortage of the valid media data in the buffer, respectively, so thatthe QoE is measured more accurately and more objectively, and networkresources can be used properly.

A method for measuring user quality of experience according to thepresent invention is hereinafter described in detail by using specificembodiments with reference to accompanying drawings.

As shown in FIG. 1, an embodiment provides a method 100 for measuringuser quality of experience QoE, where the method includes the following:

110. Receive event information sent by a receiving end, where the eventinformation includes condition information for determining a cause forshortage of valid media data in a buffer of the receiving end.

In a transmission process of network media, media data is divided intomultiple data packets. These data packets are transmitted to thereceiving end as stream, and are temporarily stored in a buffer of thereceiving end. When the amount of data stored in the buffer of thereceiving end is sufficient for the receiving end to extract and displayto a user, the receiving end starts to play a corresponding mediaprogram. When a media service system is faulty or the user drags asliding bar of the media program in a course of watching the mediaprogram, the amount of data in the buffer of the receiving enddecreases. When the amount of data in the buffer of the receiving enddecreases to a certain degree, that is, valid media data in the bufferof the receiving end is short which causes the receiving end to fail toread sufficient data from the buffer to maintain normal playing of themedia program, the receiving end may freeze the image in the mediaplaying, start to rebuffer, and send rebuffer (Rebuffering) to a QoEmonitoring server. The service system refers to a combination of varioussegments in a complete process of transmitting and playing media data.In addition, it may be understood that in the embodiment of the presentinvention, the user's action is described by using the user's draggingof the progress bar, but is not limited to the user's dragging of theprogress bar. The user's action may refer to a manual operation of theuser that causes the valid media data in the buffer to be short and thereceiving end to rebuffer. The event information includes the conditioninformation for determining the cause for the rebuffer, where thecondition information is used by the QoE monitoring server to determinethe cause for the shortage of the valid media data in the buffer of thereceiving end. Specifically, the condition information includes: mediatime stamp information in a process of playing media, that is, time atwhich valid media data in the buffer becomes short, where the timerepresents a media time stamp when the playing stops because the validmedia data in the buffer is short in the process of playing the media bythe receiving end; and time at which the media playing resumes, wherethe time represents a media time stamp when the media playing processresumes. The time at which the valid media data in the buffer becomesshort and the time at which the media playing resumes at the receivingend are both represented by using a time stamp (time stamp) method,where a unit of a time stamp is DTS (Decode Time Stamp, decoding timestamp), PTS (Presentation Time Stamp, presentation time stamp), NPT(Normal Play Time, normal play time), or the like. In addition, itshould be noted that in the embodiment, the condition information in theevent information sent by the receiving end includes two time points inthe media playing process, that is, time at which the valid media datain the buffer becomes short and time at which the receiving end resumesmedia playing, so that the QoE monitoring server independentlydetermines whether the shortage of the valid media data in the buffer ofthe receiving end is caused by the service system or caused by theuser's action. However, the present invention is not limited to the timestamps of the two time points sent by the receiving end. In theembodiment of the present invention, the condition information may be afeature flag, where the feature flag is used to represent the cause forthe shortage of the valid media data in the buffer of the receiving end.The QoE monitoring server determines the cause for the shortage of thevalid media data in the buffer of the receiving end by using the featureflag in the event information, thereby measuring QoE decrease degrees.Specifically, the implementation is as follows:

A stop flag (Stop flag) is added in the event information sent by thereceiving end, thereby distinguishing whether the shortage of the validmedia data in the buffer of the receiving end is caused by the servicesystem or caused by the user's action. If the shortage is caused by theservice system, for example, a QoS decrease, the stop flag is valid;otherwise, the stop flag is invalid. A format of the conditioninformation sent by the receiving end may be Rebuffering: Stop flag.

Alternatively, the embodiment of the present invention may alsodetermine the cause for the shortage of the valid media data in thebuffer of the receiving end by using the following conditioninformation.

A seek flag (Trick mode flag) is added in the event information sent bythe receiving end, thereby distinguishing whether the shortage of thevalid media data in the buffer of the receiving end is caused by theservice system or caused by the user's action. If the shortage is causedby the service system, the drag flag is valid; otherwise, the drag flagis invalid.

Alternatively, the embodiment of the present invention may alsodetermine the cause for the shortage of the valid media data in thebuffer of the receiving end by using the following conditioninformation.

An event flag (Event) is added in the event information sent by thereceiving end, thereby distinguishing various events that occur in themedia playing process of the receiving end. An event type in the eventinformation sent by the receiving end may be represented as Event: Stop,Trick mode, or Seek, where only one event may occur at a time.Specifically, if the event flag (Event) is identified as stop (Stop), itindicates that the shortage of the valid media data in the buffer of thereceiving end is caused by the service system; and if the event (Event)is identified as drag Trick mode or Seek, the shortage of the validmedia data in the buffer of the receiving end is caused by the user'saction. The QoE monitoring server determines, by checking the eventflag, whether the shortage of the valid media data in the buffer of thereceiving end is caused by the service system or caused by the user'saction. Only three events, namely, a combination of stop and drag, arelisted in the event flag (Event) in this implementation manner; however,the event flag is not limited to the above events. The event flag isavailable in multiple different selections or variations according torequirements.

Alternatively, the embodiment of the present invention may alsodetermine the cause for the shortage of the valid media data in thebuffer of the receiving end by using the following conditioninformation.

A drag may be defined as a special initial buffering process, that is, anew buffering type identification flag for identifying the cause for theshortage of the valid media data in the buffer of the receiving end isadded in Initial buffering. When the receiving end sends the eventinformation (Event), the buffering type identification flag isactivated. Specifically, a buffering flag is added in initial eventinformation. Specifically, a drag flag (Seek flag) is added, and if theshortage of the valid media data in the buffer is caused by the user'saction, the drag flag is valid; otherwise, the drag flag is invalid. Aformat of the QoE parameter sent by the receiving end may be Initialbuffering: Seek flag.

120. Determine, according to the condition information, whether theshortage of the valid media data in the buffer of the receiving end iscaused by the service system or caused by the user's action.

When determining information for determining the cause for the shortageof the valid media data in the buffer of the receiving end in the eventinformation is time stamp information in the media playing process ofthe receiving end, the QoE monitoring server determines, by comparingthe time at which the valid media data in the buffer becomes short andthe time at which the receiving end resumes media playing, the cause forthe shortage of the valid media data in the buffer of the receiving end;if the time at which the valid media data in the buffer becomes shortand the time at which the receiving end resumes media playing are thesame or close, or are different by Delta time units (where Delta is avery small time value), determines that the shortage of the valid mediadata in the buffer of the receiving end is caused by the service system;and if the time at which the valid media data in the buffer becomesshort and the time at which the receiving end resumes media playing donot meet the condition, that is, time stamps of the two time points aredifferent by more than two time stamps, it is deemed that the shortageof the valid media data in the buffer of the receiving end is caused bythe user's action.

Specifically, assuming that the two time points are recorded as T1 andT2, respectively, that is, the time at which the valid media data in thebuffer becomes short is T1, and the time at which the receiving endresumes media playing is T2, in a case where the T1 and T2 use NPT astime stamps, and 30 frames are played per second, if T1 is 91.5 and T2is 91.467, because in the mode where NPT is used as a time stamp, thetime increases by a unit of 0.033, the T1 and the T2 are differentexactly by Delta=0.033. In such a case, it may be determined that theshortage of the valid media data in the buffer is caused by the servicesystem, for example, a QoS decrease. If T1 is 100 and T2 is 91.467,start time and end time are different by multiple time units, andtherefore, it may be determined that the shortage of the valid mediadata in the buffer is caused by the user's action, for example,dragging. In a case where T1 and T2 use PTS or DTS as time stamps, 15frames are played per second, and a time stamp increases by a unit of67, if T1 is 3267 and T2 is 3200, T1 and T2 are different by Delta=67unit time, and therefore, it is determined that the shortage of thevalid media data in the buffer is caused by the service system. If T1 is22600 and T2 is 3267, T1 and T2 are different by more than Delta unittime, and therefore, it may be determined that the shortage of the validmedia data in the buffer of the receiving end is caused by the user'saction.

When the determining information for determining the cause for theshortage of the valid media data in the buffer of the receiving end inthe event information is a stop flag, a drag flag, an event flag, or abuffering type identification flag in the event information, the QoEmonitoring server determines, by monitoring states of the various flags,whether the shortage of the valid media data in the buffer is caused bythe service system or caused by the user's action. Specifically, whenthe event information reported by the receiving end includes a stopflag, the QoE monitoring server determines, by checking whether the stopflag is valid, whether the shortage of the valid media data in thebuffer of the receiving end is caused by the service system or caused bythe user's action; when the event information reported by the receivingend includes a drag flag, the QoE monitoring server determines, bychecking whether the drag flag is valid, whether the shortage of thevalid media data in the buffer of the receiving end is caused by theservice system or caused by the user's action; when the eventinformation reported by the receiving end includes an event flag, theQoE monitoring server determines, according to the event flag, whetherthe shortage of the valid media data in the buffer of the receiving endis caused by the service system or caused by the user's action; and whenthe event information reported by the receiving end includes a bufferingtype identification flag, the QoE monitoring server determines,according to whether the buffering type identification flag is valid,whether the shortage of the valid media data in the buffer of thereceiving end is caused by the service system or caused by the user'saction.

130. Measure QoE decrease degrees according to different causes for theshortage of the valid media data in the buffer of the end, respectively.

In this step, when the determination shows that the shortage of thevalid media data in the buffer of the receiving end is caused by theservice system, and typically, caused by the service system, forexample, caused by network congestion and a media server fault, wherethe service system includes end-to-end service-relevant components, suchas a head end, a network, and a terminal, corresponding QoS needs to bestarted to clear the fault, where QoS adjustment may be a policy such asincreasing a transmission priority of the media data stream received bythe receiving end, and/or reducing a waiting delay in a queue, and/orreducing a probability of active dropping, and/or increasing transmitpower. Starting the QoS adjustment policy may be implemented by using amedia server, or be implemented by interaction between QoE probes indistributed deployment. When the determination shows that the shortageof the valid media data in the buffer of the receiving end is caused bythe user's action, it is deemed that the impact of the shortage of thevalid media data at the receiving end caused by the user's action onuser QoE is much smaller than the impact of lack of valid buffer data atthe receiving end caused by the service system on user QoE, such as aQoS decrease. Therefore, different measuring modes are required tomeasure QoE change rates of two different causes, thereby providing anaccurate basis for whether to start QoS adjustment.

In the method for measuring QoE according to the embodiment of thepresent invention, QoE decrease degrees are calculated by determiningcauses for rebuffering, respectively, which provides a basis forsubsequent QoS optimization, thereby effectively ensuring QoE andimplementing proper use of network resources at the same time.

A QoE decrease degree is a basis for starting QoS adjustment. As shownin FIG. 2, in the embodiment of the present invention, measuring QoEdecrease degrees according to different causes for the shortage of thevalid media data in the buffer, respectively, includes the following:

S110. Obtain a stop duration (Duration) and a stop interval (Interval)in the condition information sent by the receiving end.

The Duration represents a duration from the time at which the shortageof the valid media data in the buffer causes the receiving end torebuffer to the time at which the receiving end resumes media playing,and the Interval represents a media playing time stamp interval betweenthe time at which the valid media data in the buffer becomes short andthe time at which the valid media data in the buffer becomes short lasttime.

S120. If a determination result shows that the shortage of the validmedia data in the buffer of the receiving end is caused by the servicesystem, measure a QoE decrease degree QoEΔ by using the followingformula:QoEΔ=a1×Duration+a2×Interval

where, a1 is a coefficient of QoE change caused by the stop duration,and a2 is a coefficient of QoE change caused by the stop interval.

Specifically, in the method, by using a model coefficient table, acorresponding model coefficient (a1, a2) is obtained, where morespecifically, the model coefficient may be (10.6, −0.7). The obtainedmodel coefficient and the event information are used as input parametersof a hybrid model to calculate the QoE change rate QoEΔ caused by a QoSdecrease, where a specific formula is:QoEΔ=10.6×Duration−0.7×Interval

where, 10.6 is a coefficient for calculating a QoE decrease caused bythe stop duration, and −0.7 is a coefficient for calculating QoE changecaused by the stop interval.

S130. If a determination result shows that the shortage of the validmedia data in the buffer of the receiving end is caused by the user'saction, measure a QoE decrease degree by using the following formula:QoEΔ=a3×(Duration−Threshold)

where, a3 is a coefficient of QoE change; the Duration represents aduration from the time at which the shortage of the valid media data inthe buffer causes the receiving end to rebuffer to the time at which thereceiving end resumes media playing; and Threshold is a QoE thresholdrepresenting a duration that the user may tolerate, and its unit is thesame as that of the Duration.

In addition, as shown in FIG. 3, in the method for measuring QoEaccording to an embodiment of the present invention, the following isfurther included:

140. When it is determined that the QoE change rate is greater than athreshold, start QoS adjustment for corresponding media data stream,thereby ensuring QoE of the media data stream.

The method also includes calculating a QoE value, thereby ensuring thatthe QoE value after the QoS adjustment can meets a user's requirements.The QoE value may be calculated by obtaining media sampling informationof the media data stream, where the media sampling information includesinformation such as codec information (Codec Information), codec imagesize (Codec Image Size), bit rate (Bit rate), and frame rate (Framerate). After the media sampling information of the media data stream isobtained, a model coefficient table is used to obtain a correspondingmodel coefficient (a0, a1, a2), and the obtained model coefficient andthe event information are used as input parameters of a hybrid model tocalculate the QoE value. A specific calculation formula is as follows:QoE=a0−QoEΔ=a0−(a1×Duration+a2×Interval)

where, a0 is obtained by calculation according to the codec information,codec image size, and bit rate of video information; a1 is a coefficientfor calculating a QoE decrease caused by a stop duration (Duration); anda2 is a coefficient for calculating QoE change caused by a stop interval(Interval).

The media sampling information may be included in the event information,and the receiving end sends the event information including the mediasampling information to the QoE monitoring server, so that the QoEmonitoring server can calculate the QoE value of the media data streamaccording to the media sampling information, thereby ensuring that theQoE after adjustment meets the user's expectation.

In the method for measuring user quality of experience QoE according tothe embodiment of the present invention, a QoE change rate is calculatedaccording to different causes of the buffer decrease of the receivingend, so that a QoE change rate may be measured more objectively andaccurately, thereby providing an accurate basis for whether to start QoSadjustment.

Further, the stop interval (Interval) may also be obtained bycalculation by using the following formula according to the time T1 atwhich the valid media data in the buffer becomes short and which is sentby the receiving end and the time at which the receiving end startsmedia playing:Interval=Duration+T2−T1

where, T1 is a media playing time stamp when the shortage of the validmedia data in the buffer occurs at the receiving end, and T2 is a mediaplaying time stamp when the receiving end resumes media playing.

Still further, if shortage of valid media data caused by the user'saction, such as dragging by the user, occurs at the receiving endbetween two stop intervals caused by two occasions of shortage of validmedia data in the buffer caused by the service system, in the eventinformation sent by the receiving end, start (Start) time T3_i and endtime T4_i of the user's action (dragging) occurring in a rebufferingprocess is added, and the following calculation formula is used toobtain the stop interval:Interval=Duration+T2−T1−Σ(T4_i−T3_i)+ΣDs_i

where, T4_i and T3_i are start time and end time of an i^(th) drag,respectively, and ΣDs_i is a total playing stop duration caused by thei^(th) drag, where i is a positive integer.

In addition, if a pause further occurs at the receiving end between twostop intervals caused by two occasions of shortage of valid media datain the buffer caused by the service system, the receiving end may alsosend pause (Pause) duration (Duration) information, and the followingcalculation formula is used to obtain the stop interval:Interval=Duration+T2−T1−Σ(T4_i−T3_i)+ΣDs_+ΣDp_i

where, ΣDp_i is a total duration of i pauses in a rebuffering process.

Based on the embodiments provided by the present invention, thereceiving end sends different parameters, and a server end may calculatea required current Interval value according to the sent parameters,thereby further obtaining the QoE change rate QoEΔ.

As shown in FIG. 4, an embodiment provides an apparatus 200 formeasuring user quality of experience QoE, where the apparatus 200 formeasuring user quality of experience QoE is configured to implement theabove method, and may work on a network media server or as a separatedevice in cooperation with a media server. The apparatus 200 includesthe following modules.

A receiving module 210 is configured to receive event information sentby a receiving end, where the event information includes conditioninformation for determining a cause for shortage of valid media data ina buffer of the receiving end.

In a transmission process of network media, media data is divided intomultiple data packets. These data packets are transmitted to thereceiving end as stream, and are temporarily stored in a buffer of thereceiving end. When the amount of data stored in the buffer of thereceiving end is sufficient for the receiving end to extract and presentto a user, the receiving end starts to play a corresponding mediaprogram. When a media service system is faulty or the user drags aprogress bar of the media program in a process of watching the mediaprogram, the amount of data in the buffer of the receiving enddecreases. When the amount of data in the buffer of the receiving enddecreases to a certain degree, that is, valid media data in the bufferof the receiving end is short, causing the receiving end to fail to readsufficient data from the buffer to maintain normal playing of the mediaprogram that is being played, the receiving end may start to rebuffer,and send rebuffering (Reuffering) information to a QoE monitoringserver. In addition, it may be understood that in the embodiment of thepresent invention, the user's action is described by using the user'sdragging of the progress bar, but is not limited to the user's draggingof the progress bar. The user's action may refer to a manual operationof the user that causes the valid media data in the buffer to be shortand the receiving end to rebuffer. The event information includes thecondition information for determining the cause for the rebuffering,where the condition information is used by the QoE monitoring server todetermine the cause for the shortage of the valid media data in thebuffer of the receiving end. Specifically, the condition informationreceived by the receiving module 210 includes: media timestampinformation in a process of playing media, that is, time at which validmedia data in the buffer becomes short, where the time represents amedia timestamp when the playing stops because the valid media data inthe buffer is short in the process of playing the media by the receivingend; and time at which the media playing resumes, where the timerepresents a media timestamp when the media playing process resumes. Thetime at which the valid media data in the buffer becomes short and thetime at which the media playing resumes at the receiving end are bothrepresented by using a time stamp (time stamp) method, where a unit of atime stamp is DTS (Decode Time Stamp, decoding time stamp), PTS(Presentation Time Stamp, presentation time stamp), NPT (Normal PlayTime, normal play time), or the like. In addition, it should be notedthat in the embodiment, the condition information in the eventinformation sent by the receiving end includes two time points in themedia playing process, that is, time at which the valid media data inthe buffer becomes short and time at which the receiving end resumesmedia playing, so that the QoE monitoring server independentlydetermines whether the shortage of the valid media data in the buffer ofthe receiving end is caused by the service system or caused by theuser's action. However, the present invention is not limited to the timestamps of the two time points sent by the receiving end. In theembodiment of the present invention, the condition information may be afeature flag, where the feature flag is used to represent the cause forthe shortage of the valid media data in the buffer of the receiving end.The QoE monitoring server determines the cause for the shortage of thevalid media data in the buffer of the receiving end by using the featureflag in the event information, thereby measuring QoE decrease degrees.Specifically, the implementation is as follows:

A stop flag (Stop flag) is added in the event information sent by thereceiving end, thereby distinguishing whether the shortage of the validmedia data in the buffer of the receiving end is caused by the servicesystem or caused by the user's action. If the shortage is caused by theservice system, for example, a QoS decrease, the stop flag is valid;otherwise, the stop flag is invalid. A format of the conditioninformation sent by the receiving end may be Rebuffering: Stop flag.

Alternatively, the embodiment of the present invention may alsodetermine the cause for the shortage of the valid media data in thebuffer of the receiving end by using the following conditioninformation.

A drag flag (Trick mode flag) is added in the event information sent bythe receiving end, thereby distinguishing whether the shortage of thevalid media data in the buffer of the receiving end is caused by theservice system or caused by the user's action. If the shortage is causedby the service system, the drag flag is valid; otherwise, the drag flagis invalid.

Alternatively, the embodiment of the present invention may alsodetermine the cause for the shortage of the valid media data in thebuffer of the receiving end by using the following conditioninformation.

An event flag (Event) is added in the event information sent by thereceiving end, thereby distinguishing various events that occur in themedia playing process of the receiving end. An event type in the eventinformation sent by the receiving end may be represented as Event: Stop,Trick mode, or Seek, where only one event may occur at a time.Specifically, if the event flag (Event) is identified as stop (Stop), itindicates that the shortage of the valid media data in the buffer of thereceiving end is caused by the service system; and if the event (Event)is identified as drag (Trick mode or Seek), the shortage of the validmedia data in the buffer of the receiving end is caused by the user'saction. The QoE monitoring server determines, by checking the eventflag, whether the shortage of the valid media data in the buffer of thereceiving end is caused by the service system or caused by the user'saction. Only three events, namely, a combination of stop and drag, arelisted in the event flag (Event) in this implementation manner; however,the event flag is not limited to the above events. The event flag isavailable in multiple different selections or variations according torequirements.

Alternatively, the embodiment of the present invention may alsodetermine the cause for the shortage of the valid media data in thebuffer of the receiving end by using the following conditioninformation.

A drag may be defined as a special Initial buffering process, that is, anew buffering type identification flag for identifying the cause for theshortage of the valid media data in the buffer of the receiving end isadded in Initial buffering. When the receiving end sends the eventinformation (Event), the buffering type identification flag isactivated. Specifically, a buffering flag is added in initial eventinformation. Specifically, a drag flag (Seek flag) is added, and if theshortage of the valid media data in the buffer is caused by the user'saction, the drag flag is valid; otherwise, the drag flag is invalid. Aformat of the QoE parameter sent by the receiving end may be Initialbuffering: Seek flag.

A determining module 220 is configured to determine, according to thecondition information, whether the shortage of the valid media data inthe buffer of the receiving end is caused by the service system orcaused by the user's action.

When determining information for determining the cause for the shortageof the valid media data in the buffer of the receiving end in the eventinformation is time stamp information in the media playing process ofthe receiving end, the determining module 220 is further configured todetermine, by comparing the time at which the valid media data in thebuffer becomes short and the time at which the receiving end resumesmedia playing, the cause for the shortage of the valid media data in thebuffer of the receiving end; if the time at which the valid media datain the buffer becomes short and the time at which the receiving endresumes media playing are the same or close, or are different by Deltatime units, where Delta is a time value set according to a scenariorequirement, determine that the shortage of the valid media data in thebuffer of the receiving end is caused by the service system; and if thetime at which the valid media data in the buffer becomes short and thetime at which the receiving end resumes media playing do not meet thecondition, that is, time stamps of the two time points are different bymore than two time stamps, deem that the shortage of the valid mediadata in the buffer of the receiving end is caused by the user's action.

Specifically, assuming that the two time points are recorded as T1 andT2, respectively, that is, the time at which the valid media data in thebuffer becomes short is T1, and the time at which the receiving endresumes media playing is T2, in a case where the T1 and T2 use NPT astime stamps, and 30 frames are played per second, if T1 is 91.5 and T2is 91.467, because in the mode where NPT is used as a time stamp, thetime increases by a unit of 0.033, the T1 and the T2 are differentexactly by Delta=0.033. In such a case, it may be determined that theshortage of the valid media data in the buffer is caused by the servicesystem, for example, a QoS decrease. If T1 is 100 and T2 is 91.467,start time and end time are different by Delta time units, andtherefore, it may be determined that the shortage of the valid mediadata in the buffer is caused by the user's action, for example,dragging. In a case where T1 and T2 use PTS or DTS as time stamps, 15frames are played per second, and a time stamp increases by a unit of67, if T1 is 3267 and T2 is 3200, T1 and T2 are different by Delta=67unit time, and therefore, it is determined that the shortage of thevalid media data in the buffer is caused by the service system. If T1 is22600 and T2 is 3267, T1 and T2 are different by more than Delta unittime, and therefore, it may be determined that the shortage of the validmedia data in the buffer of the receiving end is caused by the user'saction.

When the determining information for determining the cause for theshortage of the valid media data in the buffer of the receiving end inthe event information is a stop flag, a drag flag, an event flag, or abuffering type identification flag in the event information, thedetermining module 220 is further configured to determine, by monitoringstates of the various flags, whether the shortage of the valid mediadata in the buffer is caused by the service system or caused by theuser's action. Specifically, when the event information reported by thereceiving end includes a stop flag, the determining module 220 isfurther configured to determine, by checking whether the stop flag isvalid, whether the shortage of the valid media data in the buffer of thereceiving end is caused by the service system or caused by the user'saction; when the event information reported by the receiving endincludes a drag flag, the determining module 220 is further configuredto determine, by checking whether the drag flag is valid, whether theshortage of the valid media data in the buffer of the receiving end iscaused by the service system or caused by the user's action; when theevent information reported by the receiving end includes an event flag,the determining module 220 is further configured to determine, accordingto the event flag, whether the shortage of the valid media data in thebuffer of the receiving end is caused by the service system or caused bythe user's action; and when the event information reported by thereceiving end includes a buffering type identification flag, thedetermining module 220 is further configured to determine, according towhether the buffering type identification flag is valid, whether theshortage of the valid media data in the buffer of the receiving end iscaused by the service system or caused by the user's action.

A QoE measuring module 230 is configured to measure QoE decrease degreesaccording to different causes for the shortage of the valid media datain the buffer of the end, respectively.

In this step, when the determination shows that the shortage of thevalid media data in the buffer of the receiving end is caused by theservice system, for example, caused by network congestion and a mediaserver fault, a corresponding QoS needs to be started to clear thefault, where QoS adjustment may be a policy such as increasing atransmission priority of the media data stream received by the receivingend, and/or reducing a waiting delay in a queue, and/or reducing aprobability of active dropping, and/or increasing transmit power.Starting the QoS adjustment policy may be implemented by using a mediaserver, or be implemented by interaction between QoE probes indistributed deployment. When the determination shows that the shortageof the valid media data in the buffer of the receiving end is caused bythe user's action, it is deemed that the impact of the shortage of thevalid media data at the receiving end caused by the user's action onuser QoE is much smaller than the impact of lack of valid buffer data atthe receiving end caused by the service system on user QoE, such as aQoS decrease. Therefore, different measuring modes are required tomeasure QoE change rates of two different causes, thereby providing anaccurate basis for whether to start QoS adjustment.

In the apparatus for measuring QoE according to the embodiment of thepresent invention, QoE decrease degrees are calculated by determiningcauses for rebuffering, respectively, which provides a basis forsubsequent QoS optimization, thereby effectively ensuring QoE andimplementing proper use of network resources at the same time.

A QoE decrease degree is a basis for starting QoS adjustment. As shownin FIG. 5, the QoE measuring module 230 in the embodiment of the presentinvention further includes the following.

A determining information obtaining unit 232 is configured to obtain astop duration Duration and a stop interval Interval in the conditioninformation sent by the receiving end.

The Duration represents a duration from the time at which the shortageof the valid media data in the buffer causes the receiving end torebuffer to the time at which the receiving end resumes media playing,and the Interval represents a media playing time stamp interval betweenthe time at which the valid media data in the buffer becomes short andthe time at which the valid media data in the buffer becomes short lasttime.

A first calculating unit 234 is configured to, if a determination resultshows that the shortage of the valid media data in the buffer of thereceiving end is caused by the service system, measure a QoE decreasedegree QoEΔ by using the following formula:QoEΔ=a1×Duration+a2×Interval

where, a1 is a coefficient of QoE change caused by the stop duration,and a2 is a coefficient of QoE change caused by the stop interval.

Specifically, in the method, by using a model coefficient table, acorresponding model coefficient (a1, a2) is obtained, where morespecifically, the model coefficient may be (10.6, −0.7). The obtainedmodel coefficient and the event information are used as input parametersof a hybrid model to calculate the QoE change rate QoEΔ caused by a QoSdecrease, where a specific formula is:QoEΔ=10.6×Duration−0.7×Interval

where, 10.6 is a coefficient for calculating a QoE decrease caused bythe stop duration, and −0.7 is a coefficient for calculating QoE changecaused by the stop interval.

A second calculating unit 236 is configured to, if a determinationresult shows that the shortage of the valid media data in the buffer ofthe receiving end is caused by the user's action, measure a QoE decreasedegree QoEΔ by using the following formula:QoEΔ=a3×(Duration−Threshold)

where, a3 is a coefficient of QoE change; the Duration represents aduration from the time at which the shortage of the valid media data inthe buffer causes the receiving end to rebuffer to the time at which thereceiving end resumes media playing; and Threshold is a QoE thresholdrepresenting a duration that the user may tolerate, and its unit is thesame as that of the Duration.

In addition, the apparatus 200 for measuring user quality of experienceQoE according to the present invention further includes:

a QoS adjusting module 240, configured to, when it is determined that aΔQoE change rate is greater than a threshold, start QoS adjustment forcorresponding media data stream, thereby ensuring QoE of the media datastream.

The module is further configured to calculate a QoE value, therebyensuring that the QoE value after the QoS adjustment can meet a user'srequirements. The QoE value may be calculated by obtaining mediasampling information of the media data stream, where the media samplinginformation includes information such as codec information (CodecInformation), codec image size (Codec Image Size), bit rate (Bit rate),and frame rate (Frame rate). After the media sampling information of themedia data stream is obtained, a model coefficient table is used toobtain a corresponding model coefficient (a0, a1, a2), and the obtainedmodel coefficient and the event information are used as input parametersof a hybrid model to calculate the QoE value. A specific calculationformula is as follows:QoE=a0−−QoEΔ=a0−(a1×Duration+a2×Interval)

where, a0 is obtained by calculation according to the Codec Information,Codec Image Size, and Bit rate of video information; a1 is a coefficientfor calculating a QoE decrease caused by a stop duration (Duration); anda2 is a coefficient for calculating QoE change caused by a stop interval(Interval).

The media sampling information may be included in the event information,and the receiving end sends the event information including the mediasampling information to the QoE monitoring server, so that the QoEmonitoring server can calculate the QoE value of the media data streamaccording to the media sampling information, thereby ensuring that theQoE after adjustment meets the user's expectation.

In the apparatus 200 for measuring user quality of experience QoEaccording to the embodiment of the present invention, QoE change ratesare calculated according to different causes of the buffer decrease ofthe receiving end, respectively, so that a QoE change rate may bemeasured more objectively and accurately, thereby providing an accuratebasis for whether to start QoS adjustment.

Further, the stop interval (Interval) may also be obtained bycalculation by using the following formula according to the time T1 atwhich the valid media data in the buffer becomes short and which is sentby the receiving end and the time at which the receiving end startsmedia playing:Interval=Duration+T2−T1

where, T1 is a media playing time stamp when the shortage of the validmedia data in the buffer occurs at the receiving end, and T2 is a mediaplaying time stamp when the receiving end resumes media playing.

Still further, if shortage of valid media data caused by the user'saction, such as dragging by the user, occurs at the receiving endbetween two stop intervals caused by two occasions of shortage of validmedia data in the buffer caused by the service system, in the eventinformation sent by the receiving end, start (Start) time T3_i and endtime T4_i of the user's action (dragging) occurring in a rebufferingprocess is added, and the following calculation formula is used toobtain the stop interval:Interval=Duration+T2−T1−Σ(T4_i−T3_i)+ΣDs_i

where, T4_i and T3_i are start time and end time of an i^(th) drag,respectively, and ΣDs_i is a total playing stop duration Duration causedby the i^(th) drag, where i is a positive integer.

In addition, if a pause further occurs at the receiving end between twostop intervals caused by two occasions of shortage of valid media datain the buffer caused by the service system, the receiving end may alsosend pause (Pause) duration (Duration) information, and the followingcalculation formula is used to obtain the stop interval:Interval=Duration+T2−T1−Σ(T4_i−T3_i)+ΣDs_+ΣDp_i

where, ΣDp_i is a total duration of i pauses in a rebuffering process.

Based on the embodiments provided by the present invention, thereceiving end sends different parameters, and a server end may calculatea required current Interval value according to the sent parameters,thereby further obtaining the QoE change rate QoEΔ.

Through the foregoing description of the embodiments, it is clear to aperson skilled in the art that the present invention may be implementedby software plus necessary universal hardware, and definitely may alsobe implemented by hardware, but in many cases, the softwareimplementation is preferred. Based on such understanding, the technicalsolutions of the present invention essentially, or the part contributingto the prior art may be implemented in a form of a software product. Thecomputer software product is stored in a readable storage medium, forexample, a floppy disk, hard disk, or optical disk of the computer, andincludes several instructions for instructing a computer device (whichmay be a personal computer, a server, or a network device) to performthe methods described in the embodiments of the present invention.

What is claimed is:
 1. A method for feeding back infatuation by areceiving end, the method comprising: receiving media data; playing themedia data; reporting event information, wherein the event informationcomprises condition information, the condition information comprises afeature flag representing a cause for a shortage of valid media data ina buffer of the receiving end; and receiving a corresponding mediastream which is adjusted based on the reported event information,wherein the event information enables starting a quality of service(QoS) adjustment for the corresponding media stream based on thereported event information in order to ensure quality of experience(QoE) of the media stream; wherein the event information furthercomprises: a stop duration that represents a duration from a time atwhich the shortage of valid media data in the buffer causes thereceiving end to rebuffer to a time at which the receiving end resumesmedia playing, and a stop interval that represents a media playing timestamp interval between a time at which the valid media data in thebuffer becomes short and a time at which the valid media data in thebuffer becomes short last time.
 2. The method for feeding backinformation according to claim 1, wherein the cause for the shortage ofvalid media data in the buffer of the receiving end comprises: a servicesystem or a user's action.
 3. The method for feeding back informationaccording to claim 1, wherein different causes for the shortage of validmedia data in the buffer correspond to different quality of experience(QOE) measuring modes.
 4. The method for feeding back informationaccording to claim 1, wherein: the condition information comprises afirst time at which valid media data in the buffer becomes short and asecond time at which the receiving end resumes media playing, and thefirst time and the second time refer to time stamps when the receivingend plays media.
 5. The method for feeding back information according toclaim 1, wherein: the feature flag comprises a stop flag.
 6. The methodfor feeding back information according to claim 1, wherein: the featureflag comprises a drag flag.
 7. The method for feeding back informationaccording to claim 1, wherein: the feature flag comprise an event flagcomprising an event type; and when the event type is identified as astop it indicates that the shortage of valid media data in the buffer ofthe receiving end is caused by a service system, and when the event typeis identified as a seek, it indicates that the shortage of valid mediadata in the buffer of the receiving end is caused by a user's action. 8.A receiving end for feeding back information, the receiving endcomprising: a receiver, configured to receive media data and temporarilystore the media data in a buffer of the receiving end; a player,configured to extract and play the temporarily stored media data; aprocessor, configured to report event information by the receiving end,wherein the event information comprises condition information, thecondition information comprises a feature flag representing a cause fora shortage of valid media data in the buffer of the receiving end; andthe receiver is configured to receive a corresponding media stream whichis adjusted based on the reported event information, wherein the eventinformation enables starting a quality of service (QoS) adjustment forthe corresponding media stream based on the reported event informationin order to ensure quality of experience (QoE) of the media stream;wherein the event information further comprises: a stop duration thatrepresents a duration from a time at which the shortage of valid mediadata in the buffer causes the receiving end to rebuffer to a time atwhich the receiving end resumes media playing, and a stop interval thatrepresents a media playing time stamp interval between a time at whichthe valid media data in the buffer becomes short and a time at which thevalid media data in the buffer becomes short last time.
 9. The receivingend for feeding back information according to claim 8, wherein the causefor the shortage of the valid media data in the buffer of the receivingend comprises: a service system or a user's action.
 10. The receivingend for feeding back information according to claim 8, wherein differentcauses for the shortage of valid media data in the buffer correspond todifferent quality of experience (QOE) measuring modes.
 11. The receivingend for feeding back information according to claim 8, wherein: thecondition information comprises a first time at which valid media datain the buffer becomes short and a second time at which the receiving endresumes media playing, and the first time and the second time refer totime stamps when the receiving end plays media.
 12. The receiving endfor feeding back information according to claim 8, wherein: the featureflag comprises a stop flag.
 13. The receiving end for feeding backinformation according to claim 8, wherein: the feature flag comprises adrag flag.
 14. The receiving end for feeding back information accordingto claim 8, wherein: the feature flag comprises an event flag comprisingan event type comprising a stop or a seek; and when the event type isidentified as a stop, it indicates that the shortage of valid media datain the buffer of the receiving end is caused by a service system, andwhen the event type is identified as a seek, it indicates that theshortage of valid media data in the buffer of the receiving end iscaused by a user's action.